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Digital Holography at Shot Noise Level 
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Abstract — By a proper arrangement of a digital hologra- 
phy setup, that combines off-axis geometry with phase-shifting 
recording conditions, it is possible to reach the theoretical shot 
noise limit, in real-time experiments. We studied this limit, and we 
show that it corresponds to 1 photo-electron per pixel within the 
whole frame sequence that is used to reconstruct the holographic 
image. We also show that Monte Carlo noise synthesis onto 
holograms measured at high illumination levels enables accurate 
representation of the experimental holograms measured at very 
weak illumination levels. An experimental validation of these 
results is done. 



I. Introduction 

DEMONSTRATED by Gabor Q in the early 50's, the 
purpose of holography is to record, on a 2D detector, 
the phase and the amplitude of the radiation field scattered 
from an object under coherent illumination. The photographic 
film used in conventional holography is replaced by a 2D 
electronic detection in digital holography [2], enabling quanti- 
tative numerical analysis. Digital holography has been waiting 
for the recent development of computer and video technology 
to be experimentally demonstrated 0. The main advantage 
of digital holography is that, contrary to holography with 
photographic plates [1], the holograms are recorded by a 
photodetector array, such as a CCD camera, and the image is 
digitally reconstructed by a computer, avoiding photographic 
processing (31 . 

Off-axis holography is the oldest configuration adapted 
to digital holography (SJ, Q, 0. In off-axis digital hologra- 
phy, as well as in photographic plate holography, the reference 
beam is angularly tilted with respect to the object observation 
axis. It is then possible to record, with a single hologram, 
the two quadratures of the object's complex field. However, 
the object field of view is reduced, since one must avoid the 
overlapping of the image with the conjugate image alias 0. 
Phase- shifting digital holography, which has been introduced 
later 0, records several images with a different phase for 
the reference beam. It is then possible to obtain the two 
quadratures of the field in an in-line configuration even though 
the conjugate image alias and the true image overlap, because 
aliases can be removed by taking image differences. 

With the development of CCD camera technologies, digital 
holography became a fast-growing research field that has 
drawn increasing attention [Hoi . ifTTI . Off-axis holography has 
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been applied recently to particle [12] polarization [13], phase 
contrast lfT4l . synthetic aperture [fT5l . low-coherence [|T6lL IfTTI 
photothermal lH8l . and microscopic [17], [19], [20] imaging. 
Phase- shifting holography has been applied to 3D [21], ll22ll . 
color [23], synthetic aperture [24], low-coherence [|25l . surface 
shape (26l, photothermal EH, and microscopic fl2Tl. E7I. ll20l 
imaging. 

We have developed an alternative phase- shifting digital 
holography technique that uses a frequency shift of the ref- 
erence beam to continuously shift the phase of the recorded 
interference pattern [28]. One of the advantages of our setup 
is its ability to provide accurate phase shifts that allow to sup- 
press twin images aliases |[29l . More generally, our setup can 
be viewed as a multipixel heterodyne detector that is able of 
recording the complex amplitude of the signal electromagnetic 
field £ in all pixels of the CCD camera in parallel. We get 
then the map of the field over the CCD pixels (i.e. £(x,y) 
where x and y are the pixels coordinate). Since the field is 
measured on all pixels at the same time, the relative phase 
that is measured for different locations (x,y) is meaningful. 
This means that the field map £(x, y) is a hologram that can 
be used to reconstruct the field £ at any location along the 
free- space optical propagation axis, in particular in the object 
plane. 

Our heterodyne holographic setup has been used to perform 
holographic ll28l . and synthetic aperture ll24l imaging. We 
have also demonstrated that our heterodyne technique used in 
an off-axis holographic configuration is capable of recording 
holograms with optimal sensitivity (30). This means that it 
is possible to fully filter-off technical noise sources, that are 
related to the reference beam (i.e. to the zero order image 
ED), reaching thus, without any experimental effort, the 
quantum limit of noise of one photo electron per reconstructed 
pixel during the whole measurement time. 

In the present paper we will discuss on noise in digital 
holography, and we will try to determine what is the ultimate 
noise limit both theoretically, and in actual holographic exper- 
iments in real-time. We will see that, in the theoretical ideal 
case, the limiting noise is the Shot Noise on the holographic 
reference beam. In reference to heterodyne detection, we also 
refer to the reference beam as Local Oscillator (LO). We will 
see that the ultimate theoretical limiting noise can be reached 
in real time holographic experiments, by combining the two 
families of digital holography setups i.e. phase- shifting and 
off-axis. This combination enables to fully filter-off technical 
noises, mainly due to LO beam fluctuations in low-light condi- 
tions, opening the way to holography with ultimate sensitivity 
El, E3. 
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II. Off-axis + Phase-Shifting holography 



In order to discuss on noise limits in digital holography, 
we first need to give some general information on holography 
principles. We will thus describe here a typical digital holo- 
graphic setup, how the holographic information is obtained 
from recorded CCD images, and how this information is used 
to reconstruct holographic images in different reconstruction 
planes. We will consider here the case of an off-axis + phase- 
shifting holographic setup, able to reach the ultimate noise 
limit, in low-light imaging conditions, in real time. 

A. The Off-axis + Phase Shifting holography setup 



CCD 
Camera 



Hologram 

Local Oscillator(LO) 




Microscope 
Objective 



Sample 

Fig. 1. Digital holography setup. AOM1 and AOM2 : acousto-optic 
modulators; BS : beam splitter; BE : beam expander; M : mirror; Al and 
A2 : attenuator; 6 : tilt angle of the beam splitter with respect to optical axis 



The holographic setup used in the following discussion, 
is presented on Fig[T] We have considered here, a reflection 
configuration, but the discussion will be the same in case of 
transmission configuration. 

The main optical beam (complex field El, optical angular 
frequency uol) is provided by a Sanyo (DL-7 147-201) diode 
laser (A = 658 nm). It is split through a 50/50 Beam Splitter 
(BS) into an illumination beam (Ej,oji), and a LO beam 
(Elo,wlo)- The illumination intensity can be reduced with 
grey neutral filters. Both beams go through Acousto-Optic 
Modulators (AOMs) (Crystal Technology, cj aom i,2 - 80 MHz) 
and only the first diffraction order is kept. In the typical 
experiment case considered here, the modulators are adjusted 
for the 4-phase heterodyne detection, but other configurations 
are possible (8-phases, sideband detection ...). We have thus : 



with : 



(J I — UJl + W aom 2 
ULO = Ml + ^aoml 

wi -ujlo = 27r/ ccd /4 



(1) 

(2) 

(3) 



where f CC( ± is the acquisition frame rate of the CCD (typically 
12.5 Hz). 

The beams outgoing from the AOMs are expanded by Beam 
Expanders BEs. The illumination beam is pointed towards the 
object studied. The reflected radiation (E,u = ojt) and the LO 
beam are combined with a beam splitter, which is angularly 



tilted by typically 1°, in order to be in an Off- Axis holographic 
configuration. Light can be collected with an objective for 
microscopic imaging. Interferences between reflected light and 
LO are recorded with a digital camera (PCO Pixelfly): / cc d = 
12.5 Hz, 1280 x 1024 pixels of 6.7 x 6.7 /im, 12-bit. 

We can notice that our Off-axis + Phase- Shifting (OPS) 
holographic setup, presented here, exhibits several advantages. 
Since we use AOMs, the amplitude, phase and frequency of 
both illumination and LO beams can be fully controlled. The 
phase errors in phase- shifting holography can thus be highly 
reduced |[29l . By playing with the LO beam frequency , it is 
possible to get holographic images at sideband frequencies of 
a vibrating object (33), (34), or to get Laser Doppler images 
of a flow [35], E3, and image by the way blood flow, in 
vivo ll36l . ll37l . ll38l . The OPS holographic setup can also be 
used as a multi pixel heterodyne detector able to detect, with 
a quite large optical etendue (product of a beam solid angular 
divergence by the beam area) the light scattered by a sample, 
and to analyze its frequency spectrum [39], [40|. This detector 
can be used to detect photons that are frequency shifted by 
an ultrasonic wave HTTl . ll42l in order to perform Ultrasound - 
modulated optical tomography l43l. fi4l. B3, B5I. B71. l48l. 

The OPS setup benefits of another major advantage. By 
recording several holograms with different phases (since we do 
phase shifting), we perform heterodyne detection. We benefit 
thus on heterodyne gain. Moreover, since the heterodyne 
detector is multi pixels, it is possible to combine information 
on different pixels in order to extract the pertinent information 
on the object under study, while removing the unwanted 
technical noise of the LO beam. As we will show, because 
the setup is off-axis, the object pertinent information can be 
isolated from the LO beam noise. By this way, we can easily 
reach, in a real life holographic experiment, the theoretical 
noise limit, which is related to the Shot Noise of LO beam. 

B. Four phases detection 

In order to resolve the object field information in quadrature 
in the CCD camera plane, we will consider, to simplify the 
discussion, the case of 4 phases holographic detection, which 
is commonly used in Phase Shifting digital holography |9l . 

Sequence of 4n frames Iq to I± n -\ are recorded at 12.5 Hz. 
For each frame Ik, the signal on each pixel Ik,p,q (where k is 
the frame index, and q the pixel indexes along the x and y 
directions) is measured in Digital Count (DC) units between 
and 4095 (since our camera is 12-bit). The 1280 x 1024 matrix 
of pixels is truncated to a 1024 x 1024 matrix for easier discrete 
Fourier calculations. For each frame k the optical signal is 
integrated over the acquisition time T — 1/ f cc d- The pixel 
signal h,p,q is thus defined by : 

h, P ,q= / dt dxdy\E(x,y,i) + E LO (x,y,t)\ 2 

Jt k -T/2 JJ(p,q) 

where J f^ p ^ represents the integral over the pixel (p, q) area, 
and tk is the recording time of frame k. Introducing the 
complex representations £ and £lo of the fields E and Elo, 
we get : 

E(x,y,t)=£(x,y)e? u » t + c.c. (5) 



(4) 
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E LO (x,y,t) =£ LO (x,y)e J 



OJLOt 



c.c 



(6) 



h,p, g = a 2 T (7) 
(\£ p , q \ 2 + \£ LO \ 2 + £ p , q £l ^'—o)t k + c . c .) 

where a is the pixel size. To simplify the notations in Eq(71 
we have considered that the LO field Slo is the same in all 
locations (x, y), and that signal field £ P:Q does not vary within 
the pixel (p, q). If Slo varies with location, one has to replace 
Slo by S L o, P , q in EqUl 

The condition given in Eq(3] imposed a phase shift of the 
LO beam equal to tt/2 from one frame to the next. Because of 
this shift, the complex hologram H is obtained by summing 
the sequence of 4n frames Iq to I± n -\ with the appropriate 
phase coefficient : 

4n-l 

H = U) k h (8) 

k=0 

where H is a matrix of pixels H PA . We get from Eq|7] : 

4n-l 

H P, q = E 0") fc A, P ,g = 4na 2 Tf P5(? f£ (9) 

k=0 

The complex hologram g is thus proportional to the object 
field S Pj q with a proportionality factor that involves the LO 
field amplitude 



The reconstructed image H(x,y,z) in z ^ is obtained then 
by reverse Fourier transformation : 



H(x, y, z) = FFT -1 H(k x ,k y ,z) 



(13) 



In the following, we will see that the major source of 
noise is the shot noise on the LO, and we will show that 
this noise corresponds to an equivalent noise of 1 photon 
per pixel and per frame, on the signal beam. This LO noise, 
which corresponds to a fully developed speckle, is essentially 
gaussian, each pixel being uncorrected with the neighbor 
pixels. If one considers that the LO beam power is the same for 
all pixel locations (which is a very common approximation), 
the noise density of this speckle gaussian noise is the same 
for all pixels. 

In that uniform (or flat-field) LO beam approximation, all 
the transformations made in the holographic reconstruction 
(FFTs: Eq[lO|and Eq[l3l and multiplication by a phase matrix: 
EqfTTT) do not change the noise distribution, and the noise 
density. FFTs change a gaussian noise into another gaussian 
noise, and, because of the Parceval theorem, the noise density 
remains the same. The phase matrix multiplication does not 
change the noise either, since the phase is fully random from 
one pixel to the next. Whatever the reconstruction plane, the 
gaussian speckle noise on gets in the CCD plane, transforms 
into another gaussian speckle noise, with the same noise 
density. 



C Holographic Reconstruction of the Image of the Object 

Many numerical methods can be used to reconstruct the 
image of the object. The most common is the convolution 
method that involves a single discrete Fourier Transform 
1 6]. Here, we will use the angular spectrum method, which 
involves two Fourier transforms [|28l . fl24l . [49 1 . We have made 
this choice because this method keeps constant the pixel size 
in the calculation of the grid pixel size, which remains ever 
equal to the CCD pixel. It becomes then easier to discuss on 
noise, and noise density per unit of area. 

The hologram H calculated in Eq|8] is the hologram in 
the CCD plane (z = 0). Knowing the complex hologram 
H{x, y : 0) in the CCD plane, the hologram H(x,y,z)'m other 
planes (z ^ 0) is calculated by propagating the reciprocal 
space hologram H(k x ,k y ), which is obtained with a fast 
Fourier transform (FFT), from z = to z. 

H(k x ,k y ,0) = FFT[H(x,y,0)} (10) 

To clarify the notation, we have replaced here H p ^ q by 
H(x,y,0) where x and , y represent the coordinates of the 
pixel (p,q). By this way, the coordinates of the reciprocal 
space hologram H are simply k x and k y . In the reciprocal 
space, the hologram H can be propagated very simply: 

0)K(k X ,ky,Z) (11) 

where K(k x ,k y ,z) is a phase matrix that describes the prop- 
agation from to z: 

(3^{k 2 x + kl)\ 
K{k x , k y , z) = exp J —^§ ^ (12) 



III. The Theoretical Limiting Noise 
A. The Shot Noise on the CCD pixel signal 

Since laser emission and photodetection on a CCD camera 
pixel are random processes, the signal that is obtained on a 
CCD pixel exhibits Poisson noise. The effect of this Poisson 
noise, which cannot be avoided, on the holographic signal 
and on the holographic reconstructed images, is the Ultimate 
Theoretical Limiting noise, which we will study here. 

We can split the signal h,p,q we get for frame k and 
pixel (p, q) in a noiseless average component and a noise 
component: 

Ik,p,q — {Ik,p,q) H~ ^k,p,q (14) 

where ( ) is the statistical average operator, and ik,p,q the noise 
component. To go further in the discussion, we will use photo 
electrons Units to measure the signal h,p,q- 

We must notice that the local oscillator signal Slo is large, 
and corresponds to a large number of photo electrons (e). In 
real life, this assumption is true. For example, if we adjust 
the power of the LO beam to be at the half maximum of the 
camera signal in DC unit (2048 DC in our case), the pixel 
signal will be about 10 4 e, since the "Camera Gain" of our 
camera is 4.8 e per DC. There are two consequences which 
simplify the analysis. 

• First, the signal h,p,q exhibits a gaussian distribution 
around its statistical average. 

• Second, both the quantization noise of the photo electron 
signal (Ik,p,q is an integer in photo electron Units), and 
the quantization noise of the Digital Count signal (h,p,q 
is an integer in DC Units) can be neglected. These 
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approximations are valid, since the width of the h,p,q 
gaussian distribution is much larger than one in both 
photo electron and DC Units. In the example given above, 
(Ik, P ,q) — 10 4 , and this width is ~ 10 2 in photo electron 
Units, and ~ 20 in DC Units. 
One can thus consider that h,p,q, (h,p,q) and ik,p,q are floating 
numbers (and not integer). Moreover, ik,p,q is a zero-average 
random Gaussian distribution, with 



(^k,p,q) ~ (Ik,p,q) 



(15) 



To analyze the LO shot noise contribution to the holographic 
signal H Piq , one of the most simple method is to perform 
Monte Carlo simulation from EqJT4] and EqJT5] Since h,p,q 
is ever large (about 10 4 in our experiment), (Ik,p,q) can be 
replaced by Ik, P , q (that results from measurements) in the right 
member of Eq[l5j One has thus: 

(^k,p,q) = (h iPi q) — h,p,q (16) 

Monte Carlo simulation of the noise can be done from EqlT4l 
and EqfT6l 

B. The Object field Equivalent Noise for 1 frame 



Signal— ► 

E 

1 photon - 
per image 



90 % Detector 
— \CCD Pixel) 

Local Oscillator^p 
(LO) 



"shot noise" on LO 
N+/-VN photons 



Fig. 2. 1 photon equivalent signal (accounting Heterodyne gain), and shot 
noise on the holographic Local Oscillator beam. 



In order to discuss the effect of the shot noise on the 
heterodyne signal S Pyq £^ of EqJTJ let us consider the simple 
situation sketched on Fig 12 A weak object field E, with 1 
photon or 1 photo electron per pixel and per frame, interferes 
with a LO field E^o with N photons, where TV is large 
(N = 10 4 , in the case of our experiment). Since the LO beam 
signal cl 2 T\£lo\ 2 is equal to N photons, and the object field 
2 is one photon, we have: 



signal a 2 T\£ p ^ q 

Ik,p,q — N 



1 



^k,p,q 



c.c. 



(17) 



Note that the heterodyne signal £ p , q £lo is much larger 
than \£p, q \ 2 . This is the gain effect, associated to the coherent 
detection of the field £ PA . This gain is commonly called 
"heterodyne gain", and is proportional to the amplitude of the 
LO field £* Q . 

The purpose of the present discussion is to determine the 
effect of the noise term ik, P , q of EqtTT] on the holographic 
signal H Py q. Since H p ^ q involves only the heterodyne term 
£p^q£"lo (see Eqj9]), we have to compare, in EqfTTl 

• the shot noise term ik, P , q - 

• and the heterodyne term £ p , q £l 

Let's consider first the shot noise term. We have 



{il p J = (h, P , q )=N + lcN 



(18) 



a 2 T\£ p , q £* LO \ ee ((a 2 T\£ p f) (a 2 T\£ LO \ 



The variance of the shot noise term is thus \fN = 10 2 . Since 
this noise is mainly related to the shot noise on the local 
oscillator (since N ^> 1), one can group together, in EqlT7l 
the LO beam term (i.e. N) with the noise term ik, P ,q, and 
consider that the LO beam signal fluctuates, the number of 
LO beam photons being thus "TV ± y/N", as mentioned on 
FigEl 

Consider now the the heterodyne beat signal. Since we have 
N photons on the LO beam, and 1 photon on the object beam, 
we get: 

(19) 

The heterodyne beat signal £p, q £* LO i s mus \[N = 10 2 . 

The shot noise term ik, P ,q is thus equal to the heterodyne 
signal £ P ,q£Lo corresponding to 1 photon on the object field. 
This means that shot noise ik, P ,q yields an equivalent noise of 
1 photon per pixel, on the object beam. This result is obtained 
here for 1 frame. We will show that it remains true for a 
sequence of 4n frames, whatever 4n is. 

C. The Object field Equivalent Noise for An frames 

Let us introduce the DC component signal D, which is 
similar to the heterodyne signal H given by EqlU but without 
phase factors: 



(20) 



A;=0 



The component D can be defined for each pixel (p, q) by : 



4n-l 



D n 



^1 Ik,p,q 



(21) 



k=0 



Since Ik, P ,q is always large in real life (about 10 4 in our 
experiment), the shot noise term can be neglected in the 
calculation of D PA by EqEU We have thus: 



D 



p,q 



4n-l 

E 

k=0 



h,p,q = WT (\£ p 



l2 f |£ LO |2) 



(22) 



We are implicitly interested by the low signal situation (i.e. 
£ P ,q <^ £lo ) because we focus on noise analysis. In that 
case, the \£ p , q \ 2 term can be neglected in Eqj22l This means 
that D Pyq gives a good approximation for the LO signal. 



4n-l 



(23) 



k=0 



We can get then the signal field \£ p , q \ 2 from Eqj9]and Eql23l 



D 



4na 2 T\£ p 



(24) 



p,q 



In this equation, the ratio \H P)q \ 2 /D Piq is proportional to 
the number of frames of the sequence (4n), This means that 
\Hp,q\ 2 /D Pyq represents the signal field \£ Py q\ 2 summed over 
the all frames. 

Let us calculate the effect of the shot noise on \H p ^ q \ 2 / D p ^ q . 
To calculate this effect, one can make a Monte Carlo simu- 
lation as mentioned above, but a simpler calculation can be 
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done here. In Eqj24l we develop \H Piq \ in statistical average 
and noise components (as done for Ik, P ,q in EqflU), while 
neglecting noise in D Pyq . 



We get: 



\ H P,q\ 2 



where 



with 



(D P , q ) 



(\(H p , q )\ 2 + (\h p J 2 ) (25) 

((H Ptq )h; tq ) + ((H* M )h p , q ) 



( H P,Q 



An-1 

3 ik,p,q 

k=0 



(26) 



(27) 



which is the shot noise random contribution to H pA . In 
term is zero since h* is random 

and 



EqES] the ((H Ptq )h; tq 

while (H p ^ q } is not random. The two terms ((H Piq )h* 
((H p q )h P)q ) can be thus removed. 
On the other hand, we get for \h p ^ q \ 2 



k=0 



An— 1 4n— 1 

£ E 

k=0 k'=0,k'^k 



j ik,p,qik' ,p,q 



(28) 

Since ik,p,q and are uncorrelated, the ik, P ,qh',p,q terms 

cancel in the calculation of the statistical average of \h p ^ q \ 2 . 
We get then from EqfT5l 



\hr> 



An-1 

E 

k=0 



4n-l 



(\ik, P , q \ 2 ) = Yl ( 7 *J>.9> = <A>,«> (29) 



and Eql25l becomes: 



lift, 



D 



p,q 



k=0 



\(Hp,q 



(Dp,q) 



(30) 



This equation means that the average detected intensity 
signal (\H Piq \ 2 /D Pi q) is the sum of the square of the aver- 
age object field (\H p ^ q \) / ^/ (D p , q ) plus one photo-electron. 
Without illumination of the object, the average object field is 
zero, and the detected signal is 1 photo-electron. The equation 
establishes thus that the LO shot noise yields a signal intensity 
corresponding exactly 1 photo-electron per pixel whatever the 
number of frames An is. 

The 1 e noise floor we get here can be also interpreted as 
resulting from the heterodyne detection of the vacuum field 
fluctuations ll50ll . 



D. The detection bandwidth, and the noise 

From a practical point of view, the holographic detected 
signal intensity increases linearly with the acquisition time 
AnT (since \H p ^ q \ 2 / D P:Q ex An), while the noise contribution 
remains constant: the 1 e noise calculated by Eqj25] corre- 
sponds to a sequence of An frames, whatever the number An 
of frames is. The coherent character of holographic detection 
explains this paradoxical result. 

The noise remains constant with time because the noise 
is broadband (it is a white noise), while the detection is 
narrowband. The noise that is detected is proportional to the 




5 Hz 



-5 -4 



4 5 Hz 



Fig. 3. Frequency response |?7(x)| 2 for heterodyne signal in intensity, as a 
function of the heterodyne beat frequency x = f — /lo f° r sequences of 
An frames with An = A (heavy grey line), An = 8 (solid black line), and 
An = 16 (dashed black line). Calculation is done for T = 0.1 s. Vertical 
axis axis is |?7(a;)| 2 in linear (a) and logarithmic (b) scales. Horizontal axis 
is x = f - f LO in Hz. 



product of the exposure time, which is proportional to the 
acquisition time 4nT, with the detection Bandwidth, which 
is inversely proportional to 4nT. It does not depend thus on 
4nT. 

To illustrate this point, we have calculated, as a function of 
the exposure time 4nT, the frequency response of the coherent 
detection made by summing the 4n frames with the phase 
factors j k of EqJS] Let us call r] the detection efficiency for 
the signal field complex amplitude. We get: 



4n-l 

^3 k 



AnT ^ 

k=0 



kT+T/2 

t=kT-T/2 
An-1 



e j27rxt dt (31) 



sinc(TnrT) x — V j k e j2n 
K 1 An ^ 



kxT 



(32) 



k=0 



Here x = f — /lo is the heterodyne beat frequency; / is the 
optical frequency of the signal beam, and Jlo the frequency 
of the LO beam. In equation [3U the factor sinc(7rxT) corre- 
sponds to the integration of the beat signal, whose frequency 
x is non zero, over the CCD frame finite exposure time T. The 
summation over the frames k of Eq(8] yields, in Eq(3TJ to sum 
the phase e j2nkTx of the heterodyne beat at the beginning of 
each frame k with the phase factor j k . To the end, the factor 
l/4n in Eq|3l] is a normalization factor that is the inverse of 
the number of terms within the summation over k. This l/4n 
factor keeps the maximum of \rj(x)\ slightly lower than 1. 



IEEE / OSA JOURNAL OF DISPLAY TECHNOLOGY 

We have calculated, and plotted on Figj3l the detection fre- 
quency spectrum \r](x)\ 2 for sequences with different number 
of frames 4n. The heavy grey line curve corresponds to 4 
frames, the solid line curve to 8 frames, and the dashed line 
to 16 frames. As seen, the width of the frequency response 
spectrum (and thus the frequency response area) is inversely 
proportional to the exposure time ((4T) _1 , (8T) _1 and 
(16 T) -1 respectively). 




-5 -2.5 2.5 5 Hz 

Fig. 4. Frequency response for heterodyne signal in intensity, as a function 
of the heterodyne beat frequency x = f — /lo for a sequence of 4 frames: 
theory \r](x)\ 2 (heavy grey line), and experiment W(x) (points). Calculation 
and experiment are done with T = 0.1 s. Vertical axis axis is |?7(x)| 2 or 
W(x) in logarithmic scales. Horizontal axis is x = f — /lo m Hz. 

To verify the validity of Eql3U we have swept the frequency 
Jlo = mlo/C^k) of our holographic LO by detuning the 
AOMs frequency (see FigO}, while keeping constant the 
illumination frequency /. We have then measured the weight 
W(x) of the reconstructed holographic intensity signal H 2 as a 
function of the beat frequency x = j—jho- Figure |4] shows the 
comparison of the theoretical signal |r/(x)| 2 (heavy grey line), 
with the experimental data W(x) (points). The agreement is 
excellent. 

IV. Reaching the theoretical Shot Noise in 

EXPERIMENT 

In the previous sections, we have shown that the theoretical 
noise on the holographic reconstructed intensity images is 1 
photo electron per pixel whatever the number of recorded 
frames is. We will now discuss the ability to reach this limit in 
real time holographic experiment. Since we consider implicitly 
a very weak object beam signal, the noises that must be 
considered are 

• the read noise of the CCD camera, 

• the quantization noise of the camera A/D converter, 

• the technical noise on the LO beam, 

• and the LO beam shot noise, which yields the theoretical 
noise limit. 

A. The technical noise within the (k x , k y ) reciprocal space 

The main characteristics of our camera are given in Figj5] 
In a typical experiment, the LO beam power is adjusted in 
order to get 2000 DC on the A/D Converter, i.e. about 10 4 e 
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Fig. 5. Main characteristics of the PCO Pixelfly Camera 



on the each CCD pixel. The LO shot noise, which is about 
100 e, thus much larger than the Read Noise (20 e), than the 
Dark Noise (3 e/sec), and than the A/D converter quantization 
noise (4.8 e, since 1 DC corresponds to 4.8 e). The noise of 
the camera, which can be neglected, is thus not limiting in 
reaching the noise theoretical limit. 

The LO beam that reaches the camera is essentially flat 
field (i.e. the field intensity \£lo\ 2 is the same for all the 
pixels). The LO beam technical noise is thus highly correlated 
from pixel to pixel. This is for example the case of the 
noise induced by the fluctuations of the main laser intensity, 
or by the vibrations of the mirrors within the LO beam 
arm. To illustrate this point, we have recorded a sequence 
of 4n = 4 frames Ik with LO beam, but without signal (i.e. 
without illumination of the object). We have recorded thus 
the hologram of the "vacuum field". We have calculated then 
the complex hologram H by Eq(8l and the reciprocal space 
hologram H by FFT (i.e. by EqlTQb. 




Fig. 6. Intensity image of H(k x , k y ,0) for An = 4 frames without signal 
S. Three kind of noises can be identified, left : FFT aliasing, down left : 
shot noise, middle : technical noise of the CCD. By truncating the image and 
keeping only the left down part, the shot noise limit is reached. The image is 
displayed in arbitrary logarithm grey scale. 

The reciprocal space holographic intensity \H\ 2 is displayed 
on Fig(6]in arbitrary logarithm grey scale. On most of the re- 
ciprocal space (within for example circle 1), \H\ 2 corresponds 
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to a random speckle whose average intensity is uniformly 
distributed along k x and k y . One observes nevertheless bright 
points within circle 2, which corresponds to (k x , k y ) ~ (0, 0). 
These points correspond to the technical noise, which is flat 
field within the CCD plane (x, y), and which has thus a low 
spatial frequency spread within the (k x , ky) reciprocal space. 
One see also, on the Figj6] image, an horizontal and a vertical 
bright line, which corresponds to k y = and k x = (zone 
3 on FigJSJ). These parasitic bright lines are related to Fast 
Fourier Transform aliases, that are related to the discontinuity 
of the signal Ik and H at edge of the calculation grid, in the 
(x,y) space. 

We have measured (\H\ 2 ) by replacing the statistical aver- 
age ( ) by a spatial average over a region of the conjugate 
space without technical noise (i.e. over region 1). This gives 
a measurement of (\H\ 2 ), i.e. a measurement of (\H\ 2 ), since 
the space average of \H\ 2 and \H\ 2 are equal, because of 
the FT Parceval theorem. We have also measured D from the 
sequence of frames Ik (see Eql20l). Knowing the A/D conver- 
sion factor (4.8 e/DC), we have calculated the noise intensity 
(\H\ 2 )/(D) in photo-electron units, and we get, within 10%, 
1 photo electron per pixel, as expected theoretically for the 
shot noise (see Eql25t. 

This result proves that it is possible to perform shot noise 
limited holography in actual experiments. Since the low spatial 
frequency region of the reciprocal space (region 2) must be 
avoided because of the technical noise, it is necessary to 
perform digital holography in an off-axis configuration, in 
order to reach the Eqj25] shot noise limit. 

B. Effect the finite size of the pixel. 




Fig. 7. One dimension (ID) angular response of the detection efficiency for 
the intensity |sinc(X + ra7r)| 2 as a function of X for the main lobe: 
m = (a); for the main lobe and 2 aliases: m = 0, ±1 (b); for the main 
lobe and 4 aliases: m = 0, ±1,±2 (c); for the main lobe and 10 aliases: 
m = 0,±1,±2,...±5 (d). 

Because of the finite size of the pixels d p i x , the heterodyne 
detection efficiency within direction k x , k y is weighted by a 
factor ( for the field H, and \(\ 2 for the intensity \H\ 2 with: 

((k x ,k y ) = -5- / / e^+^dxdy 

a pix J x=—^dpi x J y=^dpi X 

= sinc(X)sinc(F) (33) 
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Fig. 8. Setup of the test experiment with USAF target. L: main laser; 
BS: Beam splitter; AOM1 and AOM2: acousto optic modulators; BE: beam 
expander; M: mirror; Al and A2: light attenuators. USAF: transmission USAF 
target that is imaged. CCD : CCD camera. 



with X = k x d P i X /2 and Y = k y d p i x /2. This factor ( corre- 
sponds to the angular sine diffraction pattern of the rectangular 
pixels, which affects the component of H corresponding to the 
signal of the object. The efficiency in energy |£| 2 is plotted in 
Fig0 curve (a) in black. 

Because of the sampling made by the CCD pixels, the 
hologram H(k x ,k y ) is periodic in the reciprocal space, with a 
periodicity equal to 27r/d pix for k x and k y , or tt for X and Y. 
This means that the edges of the FFT calculation grid, which 
are displayed on Fig|7]as vertical dashed lines, corresponds to 
kx, k y = ±7r/d P i X or to X, Y = ±7r/2. Note that the detection 
efficiency is non zero at the edges of the calculation grid since 
we have \(\ 2 = 4/tt 2 ~ 0.40 for X = tt/2 and Y = 0. 

If the factor |£| 2 affects the component of \H\ 2 correspond- 
ing to the signal of the object, it do not affects the shot noise 
component, whose weight is 1 whatever k x and k y are. One 
can demonstrate this result by calculating the noise by Monte 
Carlo simulation from Eqjl4] and EqJT6] The Monte Carlo 
simulation yields a fully random speckle noise, both in the 

y space, and in the k x , k y reciprocal space. 

This point can be understood another way, which is illus- 
trated by Fig|71 Each pixel is a coherent detector, whose de- 
tection antenna diagram is the Fig|7](a) sine function. Because 
of the periodicity within the reciprocal space, the signal that 
is detected for (k Xl k y ) or for (X, Y) corresponds to the sum 
of the signal within the main lobe (X, Y), and within all the 
aliases corresponding to the periodicity (X + run, Y + mfir). 
Since the object is located within a well defined direction, the 
main lobe contribute nearly alone for the signal. But this is not 
true for the shot noise, since the shot noise (or the vacuum field 
noise) spreads over all (k X: k y ) points of the reciprocal space 
with a flat average density. One has thus to sum the response 
of the main lobe (i.e. |sinc(X)| 2 in ID) with all the periodicity 
aliases (i.e. |sinc(X + ra7r)| 2 with m ^ 0). Fig |7] shows the 
ID angular response J2 m |sinc(X + m7r)| 2 that correspond to 
sum of the main lobe with more and more aliases. As seen, 
adding more and more aliases make the angular response flat 
and equal to one. 
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C. Experimental validation with an USAF target. 

We have verified that it is possible to perform shot noise 
limited holography in actual experiments, by recording the 
hologram of an USAF target in transmission. The holographic 
setup is sketched on Fig 03 We have recorded sequences of 
4n = 12 frames, and we have reconstructed the image of the 
USAF target. 



(a) 


H 


Bin ill jfl 




(c) 


(d) 






liiilii 


| ) ;| 



Fig. 9. (a,c,d): Reconstructions of an USAF target with different level of 
illumination 700 (a), 1 (c) and 0.15 e/pixel (d). (b): Simulated Shot Noise 
noise image. (e,f): Simulated reconstructed image obtained by mixing image 
(a) with weight X, and image (b) with weight 1 — X. The weight X is 
1/700 (e), and 0.15/700 (f). Images are displayed in arbitrary logarithmic 
grey scale. 

Figure shows the holographic reconstructed images of 
the USAF target. The intensity of the signal illumination is 
adjusted with neutral density filters. In order to filter off the 
technical noise, the reconstruction is done by selecting the 
order 1 image of the object, within the reciprocal space 0. 
Since the 400 x 400 pixels region that is selected is off axis, 
the low spatial frequency noisy region, which corresponds to 
the zero order image (region 1 on FigJS), is filtered-off. 

Figure (a,c,d) shows the reconstructed images obtained 
for different USAF target illumination levels. For each image, 
we have measured the average number of photo electrons per 
pixel corresponding to the object beam, within the reciprocal 



space region that has been selected for the reconstruction (i.e. 
400 x 400 pixels). The images of Fig. correspond to 700 
(a), 1 (c), and 0.15 e/pix (d) respectively. The object beam 
intensity has been measured by the following way. We have 
first calibrated the response of our camera with an attenuated 
laser whose power is known. We have then measured with the 
camera, at high level of signal, the intensity of the signal beam 
alone (without LO beam). We have decreased, to the end, the 
signal beam intensity by using calibrated attenuator in order to 
reach the low signal level of the images of Fig.[6](a,c,d). In the 
case of image (a) with 700e/pix, we also have measured the 
averaged signal intensity from the data by calculating \H\ 2 /D 
(see Eql24b. The two measurements gave the same result: 700e 
per pixel. 

On figure [9] (a), with 700e per pixel, the USAF signal is 
much larger than the shot noise, and the Sinai to Noise Ratio 
(SNR) is large. On figure 0(c), with 1 e per pixel, the USAF 
signal is roughly equal to the shot noise, and the SNR is about 
1. With 0.1 5e per pixel, the SNR is low on Fig (d) (about 
0.15), and the USAF is hardly seen. It is nevertheless quite 
difficult to evaluate the SNR of an image. To perform a more 
quantitative analysis of the noise within the images, we have 
synthesized noisy images of0(e,f) by adding noise to the Fig. 
[9] (a) noiseless image. We have first synthesized a pure Shot 
Noise image , which corresponds to the image that is expected 
without signal. 

The Shot Noise, which is displayed on Fig0(b), is obtained 
by the following way. From one of the measured frames (for 
example Jo) we have calculated the noise components ik,p,q 
by Monte Carlo drawing with the condition: 

(4,p,q) = l0,p,q (34) 

This condition corresponds to EqlT5l since (Ik,p,q) — Io,p,q- 
We have then synthesize the sequence of image Ik by: 

Ik,p,q = I(),p,q H~ ^k,p,q (35) 

The Shot Noise image of Figj9] (b) is reconstructed then from 
the Ik,p,q sequence. 



Image 


Signal (e/pix) 


Noise (e/pix) 


a 


700 


1 


b 





1 


c 


1 


1 


d 


0.15 


1 


e 


1 


1 


f 


0.15 


1 



Fig. 10. Signal and shot Noise on Images of Fig[9] 

We have synthesized noisy images by summing the noise- 
less image of Fig0 (a) with weight X, with the Shot Noise 
image of Fig 0(b) with weight (1— X). The image of Fig. [9] (e) 
is obtained with X = 1/700. As shown on the table of FigfTOl 
Fig. [9] (e) corresponds to the same signal, and the same noise 
than Figure 0(c) (le of signal, and le of noise respectively). 
Fig. 0(c) and Fig. 0(e), which have been displayed here with 
the same linear grey scale, are visually very similar and exhibit 
the same SNR. The image of Fig. is similarly obtained with 
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X = 0.15/700. It corresponds to the same Signal and Noise 
than Figure 0(d) (0.15e of signal, and le of noise), and, as 
expected, Fig. 0(d) and Fig. 0(f), which have been displayed 
here with the same linear grey scale, are similar and exhibit 
the same SNR too. 

Here we demonstrated our ability to synthesize a noisy 
image with a noise that is calculated by Monte Carlo from 
Eql34l and [35j Moreover, we have verified that the noisy 
image is visually equivalent to the image we have obtained 
in experiments. These results prove that we are able to quan- 
titatively account theoretically the noise, and that the noise 
that is obtained in experiments reaches the theoretical limit. 

V. Conclusion 

In this paper we have studied the noise limits in digital 
holography. We have shown that in high heterodyne gain of the 
holographic detection (achieved when the object field power is 
much weaker than the LO field power), the noise of the CCD 
camera can be neglected. Moreover by a proper arrangement 
of the holographic setup, that combines off-axis geometry with 
phase shifting acquisition of holograms, it is possible to reach 
the theoretical shot noise limit. We have studied theoretically 
this limit, and we have shown that it corresponds to 1 photo 
electron per pixel for the whole sequence of frame that is 
used to reconstruct the holographic image. This paradoxical 
result is related to the heterodyne detection, where the detec- 
tion bandwidth is inversely proportional to the measurement 
time. We have verified all our results experimentally, and we 
have shown that is possible to image an object at very low 
illumination levels. We have also shown that is possible to 
mimic the very weak illumination levels holograms obtained 
in experiments by Monte Carlo noise modeling. This opens 
the way to simulation of "gedanken" holographic experiments 
in weak signal conditions. 
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